SEARCHING AND SORTING MEDIA CLIPS HAVING 
ASSOCIATED STYLE AND ATTRIBUTES 
Field of the Invention 

This invention generally pertains to searching and sorting data in a database, and 
5 more specifically, to searching and sorting digital media using subjectively assigned 
criteria. 

Background of the Invention 

Electronic publishing, increasing use of graphics and sounds in email, and other 
factors have created a growing demand by computer users for clip art and other forms of 

10 media clips. When creating an electronic document with a software application, tools are 
usually provided that enable a user to browse available media clips so that an appropriate 
clip can be selected for use in the document. Most users will have at least a limited 
collection of media clips stored on a local hard drive. Alternatively, media clips are now 
readily available from various sites on the Internet, such as Microsoft Corporation's 

15 CLIP GALLERY LIVE 2000™ web site, and are also distributed on compact disk-read 
only memory (CD-ROM), DVD, and through other forms of memory media. 

As used herein, the term "media clip(s)" is intended to encompass all forms of 
digital media, including but not limited to, graphic images, sounds, animations, fonts, and 
photographs. 

20 The sheer number of media clips that are available from various sources can 

be overwhelming to a user attempting find a particular media clip most suitable to 
individual needs and taste. A person may have a collection of hundreds of media 
clips stored on a hard drive or available over a local area network (LAN) to which the 
person's computer is connected. When accessing a web site at which media clips are 

25 available, there may be thousands of choices available. Choosing a suitable media 
clip from such a vast number has become increasingly difficult and time consuming. 

One way to select a desired media clip from a database in which they are 
stored is to search the clips based on a keyword. Media clips frequently will have one 
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or more keywords associated with them that enable a user to search for media clips 
that are directed to a subject referenced by a keyword or by a category entered by the 
user. Or, a user can simply start browsing through the available clips, hoping to come 
across one that is suitable. In either case, it is desirable for a user who has searched a 
5 database based on a keyword and found a media clip that has suitable qualities, to be 
able to search for other media clips with similar qualities. These qualities will often 
be difficult to define and frequently will not be limited to a single subject. 

It would also be helpful to enable a user to sort the results of a search 
performed either on keyword or a category, so that the order in which the results are 

10 presented to the user is based upon an absolute ranking of the media clips in regard to 
a particular predefined attribute. No prior art software is available that enables media 
clips to be searched and/or sorted in this manner. It would therefore be desirable to 
provide such capabilities to assist users in selecting a suitable media clip that meets 
the needs and tastes of the user. 

1 5 Summary of the Invention 

In accord with the present invention, a method is defined for enabling media 
clips having a common desired characteristic quality to be identified from among a 
plurality of different media clips. Each of the media clips is associated with a style 
identifier that is indicative of and corresponds to a characteristic quality of the media 

20 clip. The method includes the step of enabling a desired style identifier to be 
provided as a search criterion. An automated search of the plurality of different 
media clips is then initiated, based upon the search criterion that was provided. As a 
result of the automated search of the plurality of different media clips, any media 
clips that have been associated with the desired style identifier and thus have a 

25 common desired characteristic quality are identified. 

Further, for each of a plurality of different attributes, each media clip in the 
plurality of different media clips is associated with an absolute ranking value. The 
method thus preferably also includes the step of enabling a desired attribute to be selected 
for use in sorting the plurality of different media clips, based upon the absolute ranking 

30 value of the desired attribute that was associated with each media clip. The plurality of 
different media clips is then sorted as a function of the absolute ranking value associated 
with each media clip for the desired attribute that was selected. 

The media clips that were identified by the automated search as having been 
associated with the desired style identifier can thus be sorted as a function of the 
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absolute ranking value associated with each media clip for the desired attribute that 
was selected. The plurality of media clips may be stored on a local non-volatile 
memory medium, or in a database that is accessible over a network. 

Another aspect of the present invention is directed to a system that includes a 
5 processor and a memory in which a plurality of machine instructions is stored. 
Coupled in communication with the processor are a display and a user input device. 
The processor executes the machine instructions and as a result, carries out functions 
that are generally consistent with the steps of the method discussed above. 

Brief Description of the Drawing Figures 
10 The foregoing aspects and many of the attendant advantages of this invention will 

become more readily appreciated as the same becomes better understood by reference to 
the following detailed description, when taken in conjunction with the accompanying 
drawings. The file of this patent contains at least one drawing executed in color. 
Copies of this patent with color drawings will be provided by the Patent and 
1 5 Trademark Office upon request and payment of the necessary fee. 

FIGURE 1 a color reproduction of a portion of a web page for an Internet site 
that employs the present to enable users to browse a database of media clips, based 
upon a selected category, and optionally, to browse only a selected type of media clips; 
FIGURE 2 is a color reproduction of a portion of a web page produced by 
20 browsing a selected category of media clips that have been sorted based upon an 
absolute ranking of the media clips for a selected attribute; 

FIGURE 3 is a color reproduction of a portion of a web page showing the results 
of sorting the media clips returned from browsing the category that was selected in the 
example of FIGURE 2, based upon the ranking of the media clips for a different attribute; 
25 FIGURE 4 is a color reproduction illustrating the content of a window that 

was displayed as a result of a user selecting one of the thumbnails in FIGURE 2; 

FIGURE 5 is a color reproduction of a portion of a web page showing 
thumbnail icons for media clips returned by searching on a style of the media clip 
shown in FIGURE 4, and ordered based upon a selected attribute; 
30 FIGURE 6 is a color reproduction of a portion of a web page showing sound 

media clips returned by searching for a keyword in a selected category; 

FIGURE 7 is color table showing media clips organized according to concept 
keywords in rows and according to style in columns, demonstrating that style relates 
to a different characteristic than concept or keyword; 
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FIGURES 8A and 8B are flowcharts respectively showing the logical steps 
implemented when style identifiers and attribute rankings are associated with a 
plurality of media clips, and the logical steps employed when a user searches based 
on a selected style and sorts the media clips based upon an absolute ranking of the 
5 media clips for a selected attribute, in accord with the present invention; and 

FIGURE 9 is a schematic block diagram of a personal computer (PC) system 
that is suitable for implementing the present invention. 

Description of the Preferred Embodiment 
Perhaps the most common type of media clips commonly in use are clip art files 
10 that are suitable for insertions within presentations, word processing documents, emails, 
and various other publications. Literally hundreds of thousands of clip art files are 
available to consumers over the Internet and through other sources. Currently, Microsoft 
Corporation includes clip art files with certain software application programs such as 
[% with those in its OFFICE 2000™ suite of programs, but makes many more clip art files 

Lf| 15 and other types of media clips available for downloading without charge over the 

;» a J- Internet. The media clips can be accessed using a conventional browser such as 

■ « INTERNET EXPLORER™ to connect to Microsoft Corporation's web site CLIP 

□ GALLERY LIVE 2000™, which can be accessed by entering the uniform resource 
=P locator (URL) http://cgl.microsoft.com/clipgallervlive/ in the browser address window. 
iU s 20 Alternatively, it will often be more convenient for a user to access the downloadable 
Ly media clips from within Microsoft Corporation's software programs such as 
; U PUBLISHER 2000™ or WORD 2000™ by selecting an appropriate menu option in the 
?5 program. Selection of the menu option activates a user's browser and automatically 

□ accesses Microsoft Corporation's CLIP GALLERY LIVE 2000™ web site. For 
25 example, in various versions of Microsoft Corporation's WORD™ word processing 

program, the online media clips can be accessed by selecting the menu item "Insert," and 
from the drop-down list that then appears, selecting "Picture," which opens another drop- 
down list from which "Clip Art" can be selected. Once the Clip Art menu item is 
selected, a dialogue box opens that includes an option for connecting to Microsoft 
30 Corporation's web site so that the user can search or browse the media clips available 
there and download any media clip(s) suitable for the user's needs. In some cases, the 
user may already have one or more appropriate media clips stored on a local hard drive or 
stored in a database in a hard drive on a server that is accessible over a local area network 
(LAN). Such media clips are typically stored within a folder that is shared by the various 
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Microsoft Coiporation software applications that employ media clips. When media clips 
are downloaded from Microsoft Corporation's media clip web site, they are 
automatically downloaded into a shared common folder for such applications, which 
makes them readily accessible by each of these applications if the user wants to select a 
5 clip art for a particular need from the collection in the folder. 

FIGURE 1 illustrates a portion of a web page that is displayed in a browser when 
a user connects to the CLIP GALLERY LIVE 2000™ web site and decides to browse for 
a particular media clip. In the example illustrated in FIGURE 1, a partial web page 10 
includes a label 12 that indicates that the user is reviewing media clips in a Browse mode. 

10 In this example, the user has selected a category "Featured Clips" in a drop-down list 
box 14, which is used for enabling the user to select one or more predefined categories 
for media clips. Each media clip included in the database of media clips for the site has 
been associated with at least one such category. A drop-down list box 16 enables the 
user to select one or more different types of media clips to browse within the category 

15 selected in drop-down list box 14. Currently, the different types of media clips available 
on the web site and in drop-down list box 16 include: "Anything" (i.e., all of the 
different types), "Clip Art," "Photos," "Sounds " and "Motion." Once the two selections 
from drop-down list boxes 14 and 16 are made, the user can activate a "Go" control 15, 
which causes the selected category and type of media clip to be used for limiting the 

20 browsing of the many media clips that are available in the database accessible through 
this web site. A control 17 can be selected by the user to change to a search mode, 
discussed below, and additional advanced options are accessible for searching by 
selecting a control 20. 

In the example shown, the user has selected "Featured Clips" as the category to 

25 be browsed and requested that only media clips be identified (i.e., be displayed as 
thumbnail icons) that fit within this selected predefined category. In response, 25 web 
pages of various thumbnail icons corresponding to the selected category of Featured 
Clips have been identified, and from these 25 pages, results 18 are on the first of these 
web pages. A thumbnail icon 30 is typical of the other thumbnail icons included on 

30 page 1 and is a reduced resolution, relatively smaller reproduction of the image in a clip 
art file represented by the thumbnail icon. Among the options that can be set regarding 
the display of web page 10 at the web site are the number of media clips that will be 
identified as meeting the selected criteria when browsing or searching the database and 
also, the maximum number of rows and columns of thumbnail icons that will be included 
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on each web page displayed. These options are set by making choices on a web page that 
is not shown, but which is accessed by selecting an appropriate tab displayed on the CLP 
GAT I, FRY LIVE 2000™ homepage. To select other of the pages of thumbnail icons 
that are returned when browsing or searching the database, the user may activate a drop- 
5 down list box 22, which lists the pages currently available for selection. Alternatively, a 
"previous page" control 24 (displayed as "«") and a "next page" control 26 (displayed 
as "»") are provided to enable the user to selected either the previous or next page 
among those returned by browsing or searching the database, respectively. In the 
example shown in FIGURE 1, since page 1 has been displayed, control 24 is "grayed 

10 out " since page 1 is the first in the series of the pages of media clip thumbnail icons 
returned by browsing the database in accord with the selections made by the user. 

FIGURE 2 illustrates a second example and includes a portion of a web page 32 
in which thumbnail icons 38 are returned based upon selections made by a user of 
options in drop-down list boxes 14 and 16. The results are sorted based upon ranking 

15 values assigned in connection with an attribute selected by the user in a drop-down list 
box 34. In this example, the user has selected a category entided "Plants" in drop-down 
list box 14, and has specified that all results should be Clip Art (for the type of media 
clip) in drop-down list box 16. Also, drop-down list box 34 includes the various 
attributes from which a user can optionally select when sorting the results returned from 

20 browsing or searching the database of media clips based on the entries in drop-down list 
boxes 14 and 16. In this example, the user has selected "Realistic" for the attribute, as 
indicated by a selection bar 36. 

Each of the attributes included in the drop-down list box of FIGURE 2 is 
generally applicable to clip art, while other predefined attributes may be assigned to other 

25 types of media clips. For the present embodiment, an absolute ranking for each of the 
appropriate attributes is associated with each clip art file in the database. The association 
of a ranking value for each attribute with a clip art file is done by an expert in a subjective 
determination. In this embodiment, the absolute ranking values range from a 1, for clip 
art images having the highest degree of that attribute, to a relatively greater ranking value 

30 for those media clips having proportionately less of the attribute. Table 1 lists the 
predefined attributes associated with clip art media clips and the various ranking values 
that can be associated with the clip art files for each such attribute. 
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Table 1 





Attribute 


Rank Value 


Description 




Abstract 


1 


Most Abstract 






2 


2nd Most Abstract 






3 


T 

Icons 






4 


Abstract Stylized 






5 


Abstract Whimsical 






6 


Cartoon 






7 


Realistic Cartoon 






8 


Realistic Whimsical 






9 


Alphabets, Maps, Flags and Signs 






10 


Stylized Realistic 






11 


Semi-realistic 






12 


Almost Realistic 






13 


Realistic 




BlackWhite 


1 


Black & White 






2 


Black and a Neutral Color 


: n 




3 


Black and 1 Color 






4 


Black with Limited Palette 






5 


Distinctive Black 






6 


Full-colored Images with Black 






7 


Images without Black 


ss 


Cartoon 


1 


The Most Cartoon 






2 


2nd Most Cartoon 






3 


Realistic Cartoons 


PH 




4 


Unconventional Cartoon 






5 


Whimsical 






6 


Graphic 






7 


Symbols, Alphabets, Icons, Flags and Maps 






8 


Semi-Realistic 






9 


Realistic 




Casual 


1 


Very Casual 






2 


Casual 








Casual Pre-cartoon 






4 


Cartoon 






5 


Formal Cartoon 






6 


Semi-Graphic 






7 


Graphic 






8 


Symbols, Icons, Maps, Flags and Alphabets 






9 


Graphic Realistic 






10 


Semi-Realistic 






11 


Realistic/Formal 




Colorful 


1 


The Most Colorful 
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Expressive Realistic 




7 


Sophisticated Cartoons 




8 


Cartoons 




9 


Whimsical Realistic 




10 


Stylized Realistic 




11 


Icons 




12 


Symbols, Alphabets, Signs, Flags, and Maps 




13 


The Most Abstract 
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As will be evident from Table 1 , for the attribute labeled "Abstract," a media 
clip that is the most abstract in nature of all those available, will be associated with a 
ranking value of 1 for this attribute, while media clips that are the least abstract and 
therefore tend to be the most realistic will be associated with a ranking value of 13. 
5 Various degrees of the Abstract attribute quality are associated with the intermediate 
ranking values between these two extremes, as shown in Table 1. Other attributes 
have a range of ranking values only from 1 to 9 or from 1 to 10. Table 1 does not 
show one of the predefined attributes, which is "Photographic." This attribute is 
associated with a simply binary ranking value (0 or 1), indicating that the media clip 
10 is either a photograph or not. 

FIGURE 2 is also different than FIGURE 1 in regard to the page that is 
displayed, since as indicated in drop-down list box 22, thumbnail icons 38 on page 5 
are displayed, from over 84 pages that were identified, based upon the selections 
entered by the user in drop-down list boxes 14 and 16. Since these media clips on 
15 page 5 have been sorted based upon their absolute ranking value for the Realistic 
attribute, the thumbnail icons shown on page 5 are probably less realistic than those 
found on page 1 (not shown). 

FIGURE 3 illustrates a portion of a web page 50 produced in response to the 
user selectively browsing for "Plants" as the selected category in drop-down list 
20 box 14, "Clip Art" type media clips, as indicated in drop-down list box 16, and 
selectively ordering the media clips that are identified based upon their absolute 
ranking under the attribute "Abstract," as shown in drop-down list box 34. Again, 
drop-down list box 22 indicates that the user is currently viewing page 5 on which 
thumbnail icons 52 identified in accord with the selections made by the user are 
25 displayed. It will be very apparent that the choice by the user to order the media clips 
identified based upon their rank for the attribute "Abstract" has returned a 
substantially different set of thumbnail icons on page 5 in FIGURE 3 than the 
ordering by the absolute ranking values associated with the same media clips for the 
attribute "Realistic" in FIGURE 2. The much greater abstract nature of the thumbnail 
30 icons shown in FIGURE 3 compared to those shown in FIGURE 2 clearly indicates 
the affect of ordering by two opposite attributes, i.e., "Realistic" and "Abstract". 

Assuming that a user has browsed through pages 1 to 5 for the media clips 
identified based upon the selections made as shown in FIGURE 2, viewing each of 
the thumbnail icons 30 and finally identifying a thumbnail icon 40 as being suitable 
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for an intended purpose by the user, the user then has the option of immediately 
downloading the media clip to the predefined storage location for media clips on the 
user's hard drive or in a server storage. Alternatively, the user can select a check 
box 42, indicating that the thumbnail icon 40 has been selected for subsequent 
5 download by the user. 

To immediately download thumbnail icon 40, the user can click a control 44. 
However, if a user clicks on thumbnail icon 40, a larger image 40' is displayed in a 
window 60 as shown in FIGURE 4. Window 60 also includes further information of 
potential interest to the user including a plurality of keywords 64 that have previously 
10 been assigned to the clip art file represented by thumbnail icon 40. A style 
identifier 62 associated with this media clip is also shown in window 60, giving the 
user the option of searching and identifying other media clips that have been 
associated with the same style identifier. The association of a style identifier with a 
^ clip art file is done by an expert in a subjective determination. To select either other 

S, 15 media clips associated with the same style identifier, or to select other media clips 

4 having any of the listed keywords associated with them, the user simply clicks on the 
~ style identifier or selected keyword with a mouse or other pointing device. The style 
3 identifier value displayed in window 60 serves as a control that will implement the 
h indicated action, i.e., showing other media clips associated with the same style 
=l 20 identifier, and the listed keywords each serve as a control that will search for and 
J identify other media clips associated with the selected key word. Also, the user has 
^ the option of immediately downloading the media clip referenced by thumbnail 

5 icon 40 by activating control 44. The relative size of the media clip file is listed in 
3 window 60 and the sizes of the other media clip files are next to the other thumbnail 

25 icons displayed on partial web page 32 in FIGURE 2. Accordingly, the user will 
have some idea of the required time to download each media clip, based upon the size 
of its file. 

If, in FIGURE 4, the user selects the option to search for more media clips 
that have been associated with "Style (identifier) 1," a plurality of additional media 
30 clips will be identified that meet this requirement, as shown in a partial web page 70, 
in FIGURE 5. In FIGURE 5, only a first of 27 such web pages of thumbnail icons 76 
representing media clips associated with the selected style identifier is illustrated. It 
should also be noted that by selecting search control 17 in FIGURES 2 or 3, and 
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entering a desired style identifier in a text box 74, i.e., "Style 1," the user can also 
search for media clips that have been associated with the style identifier. 

In FIGURE 5, the results shown have been identified by carrying out a search 
in the search mode as indicated by a mode label 72. The user has the option of 
5 returning to the browse mode by selecting mode control 17, which now displays the 
label "Browse." The default in this embodiment is to search for a selected style in a 
category "Everywhere" (listed in drop-down list box 14), but alternatively, a user can 
specify a specific selected category for the search. In addition, the user has the option 
of identifying the type of media clip in drop-down list box 16 for which the search 

10 should be made. Since the results have been sorted by the absolute ranking value 
associated with the selected attribute "Realistic," a thumbnail icon 78, which is 
disposed in the upper left hand corner of page 1 will have a ranking value for the 
attribute "Realistic," which is greater than or equal to that of a thumbnail icon 80, 
disposed in the lower right hand corner of the web page. Similarly, if the user 

15 displays successive pages returned by the search for media clips having the selected 
style identifier, each successive page will display thumbnail icons that will typically 
have relatively lower ranking values for the selected attribute. 

FIGURE 6 illustrates a portion of a web page 90 that is returned to display a 
plurality of thumbnail icons 92 representing media clips for which the user has 

20 searched based upon parameters entered in text box 74 and drop-down list boxes 14 
and 16. In this case, the user has entered a keyword "Cat" in text box 74, and has 
elected to search within the category "animals" selected from drop-down list box 14. 
More importantly, the user has chosen to search only for media clips representing 
sounds (e.g., *.wav files). Because of these limiting criteria, only a single page has 

25 been returned by the search, showing thumbnail icons 92. A representative icon 94 is 
shaped like a speaker to indicate that the media clip is a sound, and a descriptive 
phrase 96 is included to describe the sound provided by the media clip. Again, the 
user has the option of selectively downloading the media clip, marking it for later 
download, or previewing the media clip by clicking on icon 94, which will open a 

30 window enabling the user to hear the sound by playing it through a sound system on 
the user's PC. Thus, it should be apparent that the user has the option to search for 
different types of media clips based upon the selection made in drop-down list box 16 
and that the present invention is extensible to different types of media clips. In this 
preferred embodiment, a style identifier has not been associated with sound media 



MICR01 86- 1-1/01 8fiap.doc 



MS 149356.1 



clips. However, one can readily appreciate that style identifiers could be associated 
with any type of media clip. 

It is important to understand that the style identifier associated with each of 
the media clips in accord with the present invention is not in any way equivalent to 
5 the one or more keywords that are also associated with the media clips. While 
several keywords can be associated with each media clip, only a single style identifier 
is. Furthermore, a keyword is usually selected that relates to the subject matter of the 
media clip rather than to the kind of qualities of the media clip indicated by the style 
associated it. For example, in regard to clip art files, the style identifiers used with 

10 the collection of clip art files available at Microsoft's CLIP GALLERY LIVE 2000™ 
web site refer to over 1,100 different styles. However, it is not intended that this 
number of different styles be in any way limiting. For different types of media clips, 
substantially fewer or substantially greater numbers of different styles and related 
style identifiers may be appropriately used to provide the best indication of the 

15 characteristics of the media clips. In the present exemplary embodiment, the style 
identifiers are simply numeric values; however, it is contemplated that the style 
identifier might be any alphanumeric characters. 

Art experts have determined the appropriate style associated with media clips 
in the database available at the Microsoft Corporation web site. These art experts 

20 have reviewed each media clip and subjectively determined the appropriate style and 
thus the style identifier that should be associated with the media clip based upon the 
artistic impression and other subjective characteristics of each media clip. Although 
media clips that have common keywords may in some cases be associated with media 
clips associated with the same style identifier, the keyword is definitely not the 

25 criteria used to determine the appropriate style identifier. In many cases, it will be 
difficult to express in a few simple words the qualities of a media clip that led the art 
expert to perceive that a specific style was appropriate for association with the media 
clip. 

FIGURE 7 clearly illustrates that a concept (keyword) associated with each of 
30 a plurality of different media clips does not correspond to the style identifier that has 
been associated with the media clips. In this Figure, the concept or keywords are 
listed along the left column, while the style identifiers for each of the media clips 
illustrated are identified in the top row. Based upon a review of this Figure, it should 
be clear that media clips associated with the keyword "dog" can be represented by 
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very different styles. Similarly, media clips that create a similar artistic impression 
have the same style identifier associated with them, but do not relate to the same 
concept or keyword. For example, style identifier 149 is used in connection with a 
particular impressionistic quality that is common to each of the media clips with 
5 which that style identifier is associated. For each of the other columns that include 
media clips associated with a common style, the similarities in the qualities of those 
media clips that cause an expert to associate them with the same style identifier 
should be evident. 

Turning now to FIGURE 8A, the logical steps carried out in associating 
10 keywords, categories, style identifiers, and for each attribute, a ranking value with 
each of the media clips in a database in accord with the present invention are shown. 
A block 100 provides that an expert begins an evaluation of each media clip included 
within a database. As indicated in a block 102, for each media clip being reviewed, 
; s * e the expert carries out the following actions. First, as provided by a block 104, the 

'est 1 

m 15 expert specifies keywords and categories that will be associated with each media clip 

; ^ being reviewed. As noted above, one or more keywords and one or more categories 

^ can be associated with a clip art file and with other types of media clips. Next, in a 

O block 106, the expert selects a style identifier for the current media clip being 

= ^ reviewed from a style list. Currently, more than 1,100 styles have been defined from 

q 20 which the expert can select the most appropriate style, based upon a subjective 

LU evaluation of the various characteristics and qualities of the media clip being 

• ^ evaluated. For each of these styles, a corresponding style identifier is provided. The 

i«3 expert chooses the style, which thus determines the style identifier that will be 

Q associated with the media clip being reviewed. In a block 108, an attribute ranking 

25 value is associated with the media clip being reviewed, for each pertinent attribute, 
again based upon a subjective determination by the expert evaluating the media clip. 
As previously noted, Table 1 lists the different kinds of attributes that have been 
predefined and which may or may not be relevant depending upon the type of media 
clip being reviewed. For each relevant attribute, the subjective evaluation by the 
30 expert determines the absolute ranking for the media clip, for example, on a scale of 1 
to 9, 1 to 10, or 1 to 13, as indicated in Table 1, which applies to clip art in this 
preferred embodiment. Finally, in a block 1 10, the keywords, categories, style 
identifier, and attribute ranking values for the media clips are stored in a database in 
association with each of the media clips that were reviewed by the expert. 
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FIGURE 8B indicates the logical steps carried out when a user accesses a 
database, as indicated in a block 112. A block 114 indicates that the user may 
implement a search of the media clips in the database as a function of a keyword 
entered by the user or may browse a category to identify a media clip that best suits 
5 the needs of the user. In some cases, the user may already know of a particular style 
that is desired for the media clip. As indicated in a decision block 116, if the user 
wants to search the database, a block 1 18 provides for enabling the user to select the 
style and to initiate the search based on that style. 

The user has the option of sorting the media clips identified by the search, 

10 based on either the attribute or the style associated with the media clips, as indicated 
in a block 120. Block 120 is also reached if the user does not want to initially search 
based upon style, but instead simply wants to sort the media clips that are being 
browsed in a particular category, or to sort the media clips that were returned based 
upon a search conducted in response to a keyword entered by the user. In some 

15 cases, the resulting media clips returned from a search may be ranked in accord with 
a default attribute such as "Newer." However, the user can enter a different attribute 
as a basis for sorting the media clips that have been returned based upon the search in 
block 114 or the search in block 118. In a block 122, the system carries out a 
database query sort based upon the attribute or style entered by the user in block 120. 

20 The resulting sorted media clips are then indicated to the user and in one or more 
displayed pages. A decision block 124 gives the user the alternative option of sorting 
by a different attribute. If the user wants to sort by a different attribute, the logic 
returns to block 120. Otherwise, the logic proceeds to decision block 126, which 
determines if the user wants to do another search. If so, the logic returns to 

25 block 114, enabling the search to be conducted based on a different keyword or 
category selected by the user. If the user does not choose to do another search, the 
logic terminates, enabling the user to select from any of those media clips that have 
been identified as meeting the criteria entered by the user. 

It should be noted that the task of associating keywords, categories, style 

30 identifiers, and attribute ranking values for each of the attributes pertinent to media 
clips can be carried out using a PC, for example, by completing a series of dialogue 
. boxes for each media clip being reviewed by an expert. A software program provided 
to associate the selected keywords, categories, style identifier, and attribute ranking 
values with each media clip is relatively straightforward and simply carries out the 
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logical steps indicated in FIGURE 8A. Similarly, the database that includes the 
media clips can be searched by a user by employing the logic indicated in 
FIGURE 8B. Microsoft Corporation's CLIP GALLERY LIVE 2000™ web site 
enables a user to access the media clips stored in its database that have been 
5 processed in accord with the logic in FIGURE 8A and to carry out each of the logical 
steps indicated in FIGURE 8B after a connection is made with this web site through 
the Internet with the user's browser. Alternatively, the same logic can be 
implemented for accessing clip art and other types of media clips stored on the user's 
hard drive or in a different database accessible over a LAN to which the user is 

10 connected, by providing appropriate HTML pages for accessing the database that 
include HTML code or by using an alternative application program that implements 
the steps shown in FIGURE 8B. The media clips can also be accessed using a 
different type of interface than a browser. By providing the ability to search and sort 
by a particular style, the present invention greatly expands upon the ability of a user 

15 to identify an appropriate media clip for an intended use. 

FIGURE 9 and the following discussion are intended to provide a brief, 
general description of a suitable computing environment for implementing the present 
invention. Although not required, certain aspects of the present invention are 
described in the general context of computer executable instructions, such as program 

20 modules, that are executed by a PC 200. Generally, program modules include 
routines, programs, objects, components, data structures, etc. that perform particular 
tasks. Moreover, those skilled in the art will appreciate that this invention may well 
be practiced with other processor configurations and on a variety of very different 
types of electronic devices, including hand-held devices such as personal data 

25 assistants (Pads), pocket PCs, and cell phones, multiprocessor systems, 
microprocessor based or programmable consumer electronic devices, network 
personal computers, minicomputers, mainframe computers, home servers, small 
business server appliances, focused enterprise devices, game consoles, Internet 
appliances, and TV attached products (such as set top boxes, gaming devices, video 

30 management devices, and WebTV™). 

With reference to FIGURE 9, an exemplary system for implementing the 
present invention includes a general purpose computing device in the form of 
conventional PC system 200, provided with a processing unit 221, a system 
memory 222, and a system bus 223. The system bus couples various system 
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components including the system memory to processing unit 221 and may be any of 
several types of bus structures, including a memory bus or memory controller, a 
peripheral bus, and a local bus using any of a variety of bus architectures. The 
system memory includes read only memory (ROM) 224 and random access memory 
5 (RAM) 225. A basic input/output system (BIOS) 226, containing the basic routines 
that help to transfer information between elements within PC system 200, such as 
during start-up, is stored in ROM 224. PC system 200 further may include hard disk 
drive 216 for reading from and writing to a hard disk, not shown, and may include 
magnetic disk drive 218 for reading from or writing to a removable magnetic 

10 disk 229, and optical disk drive 220 for reading from or writing to a removable 
optical disk 231, such as a compact disk-ROM (CD-ROM), DVD, or other optical 
media. Hard disk drive 216, magnetic disk drive 218, and optical disk drive 220 are 
connected to system bus 223 by a hard disk drive interface 232, a magnetic disk drive 
interface 233, and an optical drive interface 234, respectively. The drives and their 

15 associated computer readable media provide nonvolatile storage of computer readable 
machine instructions, data structures, program modules and other data for PC 
system 200, including media clips. Although the exemplary environment described 
herein employs a hard disk, removable magnetic disk 229, and removable optical 
disk 231, it will be appreciated by those skilled in the art that other types of computer 

20 readable media, which can store data that are accessible by a computer, such as 
magnetic cassettes, flash memory cards, digital video disks, Bernoulli cartridges, 
RAM cards, ROM, and the like, may also be used in the exemplary operating 
environment. 

A number of program modules may be stored on the hard disk, magnetic 
25 disk 229, optical disk 231, ROM 224 or RAM 225, including an operating 
system 235, one or more application programs 236, other program modules 237, and 
program data 238. A user may enter commands and information into PC system 200 
through input devices such as a keyboard 240, a microphone (not shown), and a 
pointing device 242. Other input devices (not shown) include a joystick, a game pad, 
30 a satellite dish, a scanner, or the like. These and other input devices are often 
connected to processing unit 221 through an input/output (I/O) interface 246 that is 
coupled to the system bus. The term I/O interface is intended to encompass each 
interface specifically used for a serial port, a parallel port, a game port, a keyboard 
port, and/or (USB) port, as appropriate for the external devices that are thus coupled 
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to the PC system. A monitor 214 or other type of display device is also connected to 
system bus 223 via an appropriate interface, such as a video adapter 248. In addition 
to the monitor, PCs are often coupled to other peripheral output devices (not shown), 
such as printers. The speakers connected to sound card 152 are not shown in this 
5 Figure. 

PC system 200 may operate in a networked environment using logical 
connections to one or more remote computers, such as a remote computer 249. 
Remote computer 249 may be another PC, a server, a router, a network PC, a peer 
device, or other common network node, and typically includes many or all of the 

10 elements described above in connection with PC system 200, although only an 
external memory storage device 250 has been illustrated in FIGURE 9. The logical 
connections depicted in FIGURE 9 include a LAN 25 1 and a wide area network 
(WAN) 252. Such networking environments are common in offices, enterprise- wide 
computer networks, intranets and the Internet. 

15 When used in a LAN networking environment, PC system 200 is connected to 

LAN 251 through a network interface or adapter 253. If used in a WAN networking 
environment, PC system 200 typically includes a modem 254, or other means for 
establishing communications over WAN 252, and over the Internet. Modem 254, 
which may be internal or external, is connected to the system bus 223, or coupled to 

20 the bus via I/O device interface 246, i.e., through a serial port. In a networked 
environment, program modules depicted relative to PC system 200, or portions 
thereof, may be stored in the remote memory storage device. It will be appreciated 
that the network connections shown are exemplary and other means for establishing a 
communications link between computing devices may alternatively be used. 

25 Although the present invention has been described in connection with the 

preferred form of practicing it, those of ordinary skill in the art will understand that 
many modifications can be made thereto within the scope of the claims that follow. 
Accordingly, it is not intended that the scope of the invention in any way be limited 
by the above description, but instead be determined entirely by reference to the 

30 claims that follow. 



MICRO 186-1-1/01 86ap.doc 



MS 149356.1 



